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. . A 

The  U.S.  Niitional  Oce.nn  Survey  has  issued  an  experimental  copy  ol  Hnroute  Low 
Altitude  Chart  L-3/4  dated  April  21,  1977,  as  part  of  a program  to  explore  the 
feasibility  of  introducing  terrain  depiction  on  the  charts.  The  FAA's  Air 
Traffic  Service  (AAT-1)  requested  the  Office  of  Aviation  Medicine  to  determine 
what  derogatory  effects  such  a change  might  have  on  the  usability  of  the  charts. 

It  was  found  in  the  study  that  shaded  terrain  depiction  reduces  readability  of 
alpluanumer ic  data  as  measured  by  increases  in  reading  errors  and  reading  time. 
Losses  are  attributed  to  the  low  figure-to-ground  contrast  ratios  between  the 
chart  legends  and  the  terrain  background.  Losses  are  most  pronounced  for  alpha- 
numeric data  printed  in  small  character  sizes  and  with  light  inking  densities. 
Losses  are  also  evident  for  some  large  character  sizes  and  heavy  inking  densities 
where  mountainous  terrain  is  depicted  by  heavy  inking  densities.  Losses  are 
particularly  evident  under  low  luminance  levels  but  also  occur  to  a lesser  extent 
at  elevated  luminance  levels.  Differences  between  the  experimental  and  standard 
I'ersions  of  the  charts  are  least  pronounced  when  the  terrain  depiction  introduced 
only  a moderate  reduction  in  f igure-to-ground  contrast  level  and  the  items  were 
viewed  at  elevated  luminance  levels. 
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COMPARATIVE  READABILITY  OF  ENROUTE  LOW  ALTITUDE 
CHARTS  WITH  AND  WITHOUT  TERILAIN  DEPICTION 


I . Introduction. 

The  U.S.  National  Ocean  Survey  has  issued  an  experimental 
copy  of  Enroute  Low  Altitude  Chart  L-3/4  dated  April  21,  1977, 
that  depicts  terrain  features  in  shaded  relief  and,  addition- 
ally, provides  Maximum  Elevation  Figures  (MEF).  In  addition 
to  soliciting  user  comments,  the  FAA  Air  Traffic  Service 
(AAT-1)  requested  the  Office  of  Aviation  Medicine  to  conduct 
a study  to  determine  how  introduction  of  terrain  depiction 
might  affect  usability  of  the  charts. 

The  most  obvious  effect  of  shaded  relief  terrain  depiction 
might  be  to  impair  readability  of  alphanumeric  data  on  the 
charts.  Wliere  mountainous  terrain  is  depicted  as  background 
to  such  data,  the  contrast  ratio  is  considerably  reduced  from 
ratios  found  on  standard  charts. 

A limited  study  of  the  comparative  readability  of  selected 
categories  of  data  appearing  on  the  charts  was  conducted  by 
the  Vision  Research  Unit  of  the  FAA  Civil  Aeromedical  Institute's 
Aviation  Physiology  Laboratory  (AAC-115).  The  study  was  restricted 
to  consideration  of  simple  readability  as  a discrimination  task  and 
did  not  address  such  factors  as  search  time  for  specific  informa- 
tion or  the  ability  to  use  the  charts  in  flight. 

II . Methods . 

Five  categories  of  information  appearing  on  the  experimental 
terrain  depiction  versions  of  Enroute  Low  Altitude  Charts  L-3  and 
L-4  were  selected  as  being  representative  of  the  alphanumeric  con- 
tent of  the  charts.  The  five  categories  ate  as  follows:  (i) 

UHF/VHF  Airway  and  Route  Data,  (ii)  Aerodromes  Without  Published 
Instrument  Approach  Procedures,  (iii)  Air/Ground  Communication 
Boxes,  (iv)  ARTCC  Remoted  Site  Boxes,  and  (v)  Maximum  Elevation 
Figures . 

Six  samples  of  each  of  the  first  four  categories  were  selected 
from  the  experimental  charts.  Three  samples  in  each  category  wore 
chosen  ns  representative  of  a dense  terrain  background  (low  terrain 
contrast)  and  three  as  representative  of  an  intermediate  terrain 
background  (moderate  terrain  contrast).  In  addition,  12  MEF  figures 
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were  selected  from  the  terrain  depiction  chart  to  provide  four 
samples  at  each  of  three  relative  contrast  ratios  (high,  medium, 
and  low).  No  attempt  was  made  to  quantify  the  contrast  ratios 
or  equate  them  within  categories  on  other  than  a subjective  basis. 
A listing  of  the  test  items  (samples)  is  given  in  Table  1. 

Tlie  selected  test  items  were  cut  from  the  experimental 
versions  of  the  charts  in  rectangular  sections.  Corresponding 
samples,  except  for  MEF  numerals,  were  cut  from  standard  issues 
of  the  charts.  Extraneous  data  appearing  on  the  60  test  items 
were  deleted  to  minimize  confusion  with  the  data  to  be  evaluated. 
The  items  were  then  mounteil  in  four  random  sequences  on  a dis- 
play drum.  Items  were  presented  singly  through  a 2.4-  by  3.0-cm 
(0.9-  by  l.2-in)  viewing  aperture  in  a neutral-gray  occluder  plate. 

The  viewing  aperture  and  the  surrounding  area  were  illuminated 
by  a 60-W  incandescent  bulb  (General  Electric  Daylight  Blue) 
mounted  in  a stainless  steel  reflector.  Luminance  levels  of  0.25, 
l.OO,  and  4.00  fL  were  achieved  by  regulating  the  voltage  applied 
to  the  bulb.  Luminance  in  the  aperture  was  measured  by  a 
Pritchard  Spectra  Photometer  fri’m  a white  oxide  diffuser  plaque 
immediately  behind  the  aperture. 

Test  subjects  were  ll  male  and  '!  female  non-pilot  volunteers. 
Non-pilot  subjects  were  used  in  order  to  avoid  the  confounding 
factor  of  variable  experience  levels  found  in  the  pilot  population. 
All  subjects  had  20/20  near  visual  acuity  corrected  by  reading 
glasses  or  bifocal  lenses  when  necessary.  Subjects'  ages  ranged 
from  27  to  58  years  with  a mean  age  of  45  years.  The  subjects 
viewed  the  display  from  a distance  of  40  cm  (15.7  in)  as  measured 
from  the  apex  of  the  cornea  to  the  center  of  the  aperture. 

The  subjects  were  read  the  instructions  and  shown  a repre- 
sentative sample  of  each  category  of  test  items.  It  was 
emphasized  that  they  should  respoinl  as  quickly  as  was  consistent 
with  accuracy  and  completeness  and  should  not  spend  undue  time 
on  difficult  items.  The  display  illumination  was  adjusted  to 
the  level  specified  for  the  first  trial  ami  the  room  lights 
were  extinguished.  A 2-minute  adaptation  period  precevied  the 
beginning  of  the  first  series  of  test  items.  The  60  items 
were  presented  with  a short  interruption  after  every  15th  pre- 
sentation to  reposition  the  drum  for  the  next  list.  Wlien  sub- 
jects had  completed  the  last  item,  the  illumination  was  adjusted 
to  the  next  level  and  the  procedure  repeated.  A third  trial 
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TAHLK  I.  'r»>st  ItiTis  Willi  I’liart  Locations 


TEST  ITLM 

imF/VIlE  Airway  ainl  Konlo  Hata 

MoJorato  T’orrain  Tontrast 

V-2S{) 

V-2'> 

V~l‘^7 

l.iiw  Ti'vrain  Contrast 

V-lOI-L’l? 

V-190 

V-237 


AiTOiloiiio  l.o^i'niis 

Modorato  'IVrrain  Contrast 

Conclias  State  Park 
Grant  s-Mi Ian 
diamond  A.  Ranch 

Low  Ti'rrain  taint rast 


Transwestorn 
St . Johns 
Papilad 

Air/Grotiiul  Commimlcat  ion 


Moderate  Terrain  Contrast 

The  rma 1 
Santa  Harhara 
San  Luis  Obispo 

Low  Terrain  Contrast 

Sr.  Johns 
Santa  Fe 
2-nn  i 


CHART 


103‘’00'  W 
120‘\H)'  W 
118'’ 30'  W 


112'’l5'  W 
11  O'’ 1.3'  W 
11  A'’ 30'  W 


10A'’l3'  W 
108”00'  W 
103‘’l0'  W 


109‘’l5'  V7 
lO^l^JO*  W 
lIJ^’ll)'  W 


llfi'’23'  W 
119'’33'  W 
120'’30'  W 


10'l‘’20'  W 
10(i‘’30'  W 
100'’l3'  W 


REFERENCE 


33'’00'  N 
34‘’40'  N 
33^00'  N 


34‘’13'  N 
34'’00'  N 
33'’ 10'  N 


33^20'  N 
3.3'’l3'  N 
33'’20'  N 


35'’30'  N 
34'’30'  N 
34‘’40'  N 


33” 33’  N 
34”33'  N 
33'’13'  N 


34'’l3'  N 
33'’4S'  N 
33‘’20'  N 


TA1U.1  1.  Tost  Hems  With  Chart  Locations  (Cont  . > 


TKST  ITKM 


CHART  RKFKKKNCK 


ARTC(’  Remo  ted  Sites 


Moderate  Terrain  Contrast 

Albuquerque  - Tucumcari 
Los  Angeles  - Julian 
Albuquerque  - Clines  Cr. 

J.ow  Terrain  Contrast 

Albuquerque  - Globe 
Los  Angeles  - Seligman 
Albuquerque  - Trvitb  or 
Consequences 

Maximum  Klevation  Figures 
High  Terrain  Contrast 


Moderate  Terrain  Contrast 

9 - 1 
10-0 
11-2 
6-9 


un”A5'  w 

105"25’  W 


1 1 1 ‘ 00 ' w 
ii:3'\)0'  w 

107''\‘j0’  W 


3S‘  2'>'  N 
,33'''' 00'  N 
JS^'lC  N 


LINOS'  K 
N 


33  OS’  N 


6-2 

lOA-lOs'' 

W 

1 

N 

10  - A 

117-118^' 

VJ 

3A-3S 

N 

A - 8 

102-103"" 

W 

3S-36"’ 

N 

S - ? 

103-10A"" 

W 

3A-3S‘' 

N 

lOA-105 

W 

31-32"’ 

N 

105-106"’ 

W 

32-3  3"’ 

N 

116-117"’ 

W 

33-3A"’ 

N 

116-117"’ 

w 

32-33*’ 

N 

I.ow  Terrain  Contrast 

9 - S 
11-8 
II  - 1 
7 - 7 


llO-lll"’ 

w 

32-33"’ 

N 

109-110"’ 

w 

33-3a"’ 

N 

109-110"’ 

w 

32-13"’ 

N 

llO-lll"’ 

w 

35-36"’ 

N 

A 


was  iht'n  run  with  tho  Iasi  i I luiuinat  ion  level  for  a total 
of  tlirei'  preseiitat  ions  of  the  00  items.  Illumination  level.s 
anJ  list  senuences  wort'  countorba  1 ancotl  to  minimize  system.iiic 
bias . 

Subjects  rt'spondetl  by  reading  alouii  all  the  alphanumeric 
data  appearing  in  each  test  itt'iii.  Kesponses  were  tape- 
recorded  for  subsequent  scoring  of  error  content  and  response 
t ime . 

111.  Results. 

I'he  results  for  the  four  categories  of  information  appt'aring 
on  botli  versions  of  the  chart  are  presi-nted  in  Tables  2-S.  I'he 
introduct  it'll  of  terrain  depiction  resulted  in  a variable  degree 
of  loss  of  readability  of  alphanunu'ric  data  as  tiemonst  rat  eti  by 
increased  frequency  of  errors  and  increased  re.ading  tinu's.  Tlie 
loss  of  reatlability  was  minimal  whore:  (i)  the  tt'rrain  depic- 
tion introduced  only  a moderate  rt'tiuction  in  f i gnre-t  o-grouiivl 
contrast  levels,  (ii)  character  sizes  were  relatively  large 
and/or  printed  with  a lieavy  inking  ilensity,  and  (iii)  the 
i 1 Inminat  ion  was  at  least  1.00  fl,. 

Three  types  of  reading  errors  are  ith'nt  i f iei!  in  the  tables. 
"Misreatl  ing"  errors  are  those  in  which  the  test  item  was  rt'.ui 
correctly  except  for  one  or  iiu're  digits  in  a large  grv'up. 

"Major  Omission"  errors  are  those  in  which  a complete  line, 
including  a place  name  or  digit  group,  were  omitti’il.  "No 
Response"  errors  are  those  for  which  the  subjects  reported 
inability  to  read  any  part  of  the  test  item.  The  "irror  Kate" 
expresses  the  total  number  of  errors  as  a pt  rci'iit  of  I In-  total 
number  of  responses.  Percent  values  have  b»'<'n  rounded  to  the 
nearest  full  percentage  point. 

In  addition,  two  types  of  "Time  Scores"  .iri'  pri’sentO'!  in 
the  Cables.  "Recognition  Time"  is  tlie  time  lapsi’  bi'twei'ii  tin- 
presentation  of  the  test  item  and  the  initial  ii'n  I'f  the  verl'al 
response.  If  subjects  ri'perli'd  inability  to  n'ad  lh>'  item, 
recognition  time  values  were  scored  as  1 "i  sei-oiiils  1 1'  pri'vivle 
a numerical  value  for  statistical  computation.  "Kv'.nling  I'inu'" 
is  tin'  lime  lapse  between  presentation  of  the  l»'st  iti'm  aiivt 
the  completion  of  the  vt'rbal  response.  If  subjects  repot  t I'd 
inability  to  read  the  item,  reatling  time  values  wort'  scoti'il 
as  30  seconds.  Scores  of  13  aitd  30  si'conds  noted  ahi've  w<'r<' 
selected  to  represent  "Recognition  Time"  an>l  "R''a>ling  Tiim's" 


TABLC  2.  Comparative  Error  an'^  " ' n"  S ore  f .r  I'HF/VHF  Airway  and  Route 
Data  at  Two  Contrast  .-evels  and  Three  Luminance  Levels 


Percent  Increase 


TABLE  5.  Comparative  Error  and  Time  Score  for  ARTCC  Remoted  Site 
Boxes  at  Two  Contrast  Levels  and  Tliree  Luminance  Levels 
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slightly  lougi'r  I h;m  I iiiu’S  rotiii  i ri'd  hy  I lio  sluwcsl  I'fiulcr. 

11  .1  "M.ijor  Omission"  I'l  roi'  w;is  scoml  for  the  itom,  ilio  ailii.il 
ro.iil  i iig  t i nio  was  houhloh,  siihjoit  to  t lu’  iO-soooiul  maxiimiiii 
valiio.  "I'l' roi'iit  liici'oasi'"  values  are  (he  iuereasi's  iu  time 
rei|uireh  lo  respouil  to  the  lerraiu  eiuui'pt  items  eom|)areil  to 
u'  stauilarJ  versiiui  ot  (he  same  iti'ms.  The  two  values  in 
parentheses  in  Tahle  ? indieati'  deereases  in  reading  times. 

All  percent  ape'  valni's  have  hemt  rounded  to  the  nearest  full 
percentage  point. 

Tin'  data  lor  the  MllKs  .ire  presented  in  Tahle  (>.  The  error 
di'tinitions  are  the  s.ime  as  lor  the  other  c.'itegories  ol  inlor- 
mation  except  that  the  "H.ijor  Omission"  caleg,ory  is  not  included 
hecanse  of  the  limitiul  numerii'  content  of  these  test  items, 
l ime  scores  lor  the  Ml'Ks  follow  t hi>  crili'ri.i  for  the  other 
categ.ories  ol  test  items  except  that  "Kecogn  i t i on  Time"  was 
limited  to  ,i  maximum  ol  10  si'coiuls  and  "Ke.iding,  Tiim'"  to  a 
maximum  ol  !’0  seconds  in  order  to  .ivi'id  exci-ssive  distort  ion 
ot  time  scores  for  items  th.it  normally  havi'  a vi-ry  short  re.iding 
time.  I’eri'enI  iiuri'.ase  values  for  t hi'  medium  and  low  contrast 
items  .ire  based  on  comparison  with  the  high  coni  r.ist  level 
i t ems . 

1 V . ni  sctiss  i on  . 

An  elleci  i ve  lerr.iin  depict  ion  .‘‘orm.il  .appears  to  depend  on 
esi  .ih  1 i shmi'nl  ol  .acceptable  contrast  ratios  between  t be  .a  I ph.a- 
nnmeric  information  .and  the  terrain  b.acUgronnd.  Such  ratios  must 
not  only  pi<>vide  li>r  .aderpial  e re.ail.ab  i I i 1 y of  the  .a  1 |ih.anumer  i c 
inlorm.at  ion,  but  also  must  accommodate  a wide  enonj'.h  range  in 
terrain  printing,  densities  to  elleci  ively  depict  I be  terrain 
h.ic !<;; round  . 


If  terrain  densil  ies  are  eipial  lo  or  less  t h.in  the  inter- 
mediate v.alnes  used  in  this  study,  only  minim.al  changes  in 
character  sice  or  ilensity  v^i  1 1 be  necessaty  to  assure  adeipi.ale 
re.adabilily  ol  the  ch.irls.  If  terrain  printing,  densities 
c.ansing,  low  contrast  .are  iililizi'd,  it  will  be  necess.ary  lo 
consider  inere.ising,  I be  size  of  the  alphanumeric  ch.ar.aclers. 

Tout  r.isl  enh.ancemeni  hy  use  of  selected  color  comb  i n.al  i ons  , 

■ ilternate  svmbology,  and  reduction  ol  lerr.iin  printing  den- 
sities behind  alphanumeric  d.-il  a (blocking,)  mig.ht  also  be  considered. 


.•^peeilic  reeommend.i  I i ons  for  pro\iding 
of  a given  lorm.it  must  be  developed  on  the 
leri  i g.overning  the  purpose  of  the  chart  , 


m.ax  i miim  re.ad.ib  i 1 i t y 
has i s o I I he  c i i - 
■fheie  is  abniidanl 
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literature  addressed  to  the  general  problem  of  readability 
of  the  printed  word  and  graphic  material.  A good  summary 
of  map  and  chart  design  for  aviation  has  been  issued  by  the 
Australian  Department  of  Civil  Aviation  that  also  includes 
an  extensive  reference  section  providing  coverage  of  tlie 
pertinent  literature  (1). 

All  subjects  in  this  study  had  good  vision  and  were  viewing 
the  chart  elements  under  ideal  laboratory  conditions.  Common 
in-flight  factors  such  as  degraded  visual  acuity,  vibration, 
turbulence,  distraction  and  stress  would  logically  be  expected 
to  reduce  chart  readability  below  the  levels  found  in  this  study. 
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